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Method and apparatus for determining the phase and/or 
amplitude information of an electromagnetic wave 

The invention concerns a method and an apparatus for 
determining the phase and amplitude information of an 
electromagnetic wave. 

The term phase here generally stands for phase transit 
5 time and for the designation transit time which is also 
used according to the respective signal shape involved. 

Hereinafter reference is made to a light wave instead 
of an electromagnetic wave. That however does not denote 
a restriction only to the spectral range of visible 
10 electromagnetic waves, but is only for the purposes of 
simplification. 

For the measurement of frequency components in terms 
of amplitude and phase in wide-band and high-frequency 
signals, the electronic measuring art and communication art 
15 frequently use phase detectors which multiply or mix the 
unknown signal with a sine oscillation and determine the 
steady component which occurs in the presence of a signal 
component of the same frequency by integration or low-pass 
filtering. 

20 That procedure produces the correlation function of 

the unknown signal with the mixing signal for a given, 
adjustable relative phase position. By altering the mixing 
frequency (sweep) the unknown signal can be broken down 
into its spectral components. Steady component, varying 

2 5 amplitude and phase of the unknown frequency component of 
the same frequency can be determined by at least three 
phase positions. 



3 0 measuring and communication arts is implemented nowadays 
inter alia by way of wide-band photodetectors as electro- 



The investigation of corresponding optical signals 
which have acquired increasing significance in the 



optical transducers with subsequent electronic measurement 
value ascertainment, as previously described for electrical 
signals . 

Because of the high level of expenditure involved 
5 those methods and the corresponding measurement apparatuses 
are usually only of a one- or two-channel nature. In the 
case of optical signals however very many parallel channels 
in particular entire image sequences - with high 
frequency components frequently Have to be surveyed 

10 simultaneously. 

Besides the spectral modulation properties of two- 
dimensional light waves, an aspect of increasing interest 
is the rapid run of the envelope in space and time. In 
addition there is a wish to provide for rapidly and 

15 accurately surveying 3D-objects, for example by way of 
optical radar processes, which requires very fast detectors 
in the sub-nanosecond range, as a result of the light speed 
of the echo signals. At the same time they should be 

. . available as a detector array if there is desire to avoid 

20 the time-consuming operation of scanning the actively or 
passively bright 3D-objects. 

Such a 3D-camera is proposed in DE 44 3 9 298 Al which 
the present invention takes as its basic starting point. 

Figure 10 is intended to illustrate that 3D-camera 

25 which is based on the echo transit time or phase transit 
time process. The HF-modulated light wave 101 which is 
irradiated by a modulated light transmitter 107 and 103 and 
reflected by the 3D-object 100 contains all the depth 
information in the delay in respect of the phase front. If 

3 0 the incident light wave is modulated once again in the 
reception aperture 102 with a two-dimensional, optical 
mixer 104 of the same frequency, which corresponds to a 
homodyne mixing or demodulation process, the result is a 
steady high-frequency interf erogram . 

3 5 That HP- interf erogram can be recorded with a 

conventional CCD-camera 105 and subjected to further 



processing with an image processing arrangement 106. 
Integration of the steady component of the mixed product in 
the CCD-photoelectric charge corresponds to the formation 
of the correlation function of the two mixing signals. The 
5 distance-related phase delays due to the echo transit times 
and the amplitudes can be calculated pixel-wise from three 
or more interf erograms by virtue of different phases of the 
demodulating mixing frequency, for example 0°, 12 0*^ and 24 0° 
or 0°, 90°, 180° and 270°, and thus the 3D-depth image can 

10 be reconstructed. 

The two-dimensional optical mixer 103 or 104 which is 
also referred to as a spatial light modulator or SLM 
comprises in that case for example a Pockel cell which has 
a series of serious disadvantages which are described in 

15 the literature. 

Further implementation options are afforded by LCD- 
windows which are admittedly inexpensive but which are 
about a factor of 1000 too low in terms of the desired band 
width . 

20 The use of a so-called microchannel plate, as is used 

in image amplifiers, is also expensive and costly. The 
gain can be modulated by modulation of the acceleration 
voltage which is applied to the microchannels and which 
influences the secondary electron emission in the 

25 microchannels. 

Furthermore, the state of the art sets out a proposal 
for a 2D-correlator based on a CCD-photodetector array: 
"The Lock- In CCD-Two-Dimensional Synchronous Detection of 
Light" by Spirig, Seitz et . al . , published in IEEE Journal 

30 of Quantum Electronics, Vol. 31, No. 9, September 1995, 
pages 1705 - 1708. There, a photopixel is interrogated by 
way of four transfer gates in order to ascertain the phase 
of sine-modulated light. For each sine ^period, a 

respective equidistant sample is taken with the four 

35 transfer gates, whereby the phase can be easily calculated. 
That procedure is too slow for the indicated problems as 



the harmonic light signal is firstly integrated on during 
a scanning duration which significantly delimits the band 
width. It is only then that the desired mixing process is 
implemented with the stored charge being taken over as the 
5 scanning sample , 

The object of the present invention is therefore that 
of providing a method and an apparatus for determining the 
phase and/or amplitude information and thus the envelope of 
a light wave, which permit a simpler, wider-band and less 
10 expensive correlator concept and rapid 3D-object surveying 
by way of a predeterminable lighting. 

The above- indicated object is now attained by the 
method as set forth in claim 1 and by the photonic mixing 
element as set forth in claim 14, by the mixing element 
15 arrangement set forth in claim 20 and by the apparatus set 
forth in claim 23 . 

The principle according to the invention is based on 
a drift produced by the modulation photogate voltage and 
separation of the minority charge carriers photo-generated 

2 0 by the light wave in the material beneath at least two 

adjacent light-sensitive modulation photogates. In this 
case those charge carriers drift under the influence of the 
modulation photogate voltages U^^^iCt) and U^^j^Ct) applied to 
the modulation photogates, depending on the respective 

25 polarity or phase involved, to the accumulation gates which 
are biased with preferably double the dc voltage and Uy^. 
The modulation photogate voltages U^m^^^ eind U^^{t) are 
preferably complementarily applied and are preferably 
composed of a bias voltage Uq and the modulation voltage 

30 +Uj^(t) and -Uj„(t) respectively superimposed in push-pull 
relationship. The two modulation photogates together 
preferably form a square surface. A pixel with only two 
modulation photogates can also be referred tO; as a dual 
pixel . 

3 5 This principle according to the invention presupposes 

the photoelectric quantum effect, caused by electromagnetic 



5 



waves. Nonetheless, reference will always be made to light 
waves, without this being interpreted as a limitation. 

The actual mixing or multiplication process lies in 
the modulation voltage-dependent or phase -dependent drift 
5 of the photo-generated charge carriers to the right or to 
the left side of the modulation photogate ("charge swing") . 
In that respect the charge difference between the charge 
carriers which are separated in that way and collected 
under the accumulation gates and transmitted to the 
10 electronic reading-out system, having regard to integration 
in a predetermined time, represents a measurement in 
respect of the correlation function of the envelope of the 
incident modulated light signal and the modulation voltage 
U,(t) . 

15 At the same time the charge sum of those charge 

carriers which have drifted to the accumulation gates and 
passed on remains uninfluenced by the position of the 
charge swing and is available as suitable pixel intensity 
or as pixel grey value. 

20 In order to determine the relative phase or time delay 

of the incident light wave, it is necessary - as described 
above - to implement three measurements in respect of the 
three parameters dc voltage component and ac voltage 
component and relative phase. Therefore, it is possible 

25 to involve a configuration of the pixel of the photonic 
mixing element with three light-sensitive modulation 
photogates which are acted upon by modulation photogate 
voltages which involve three different phase shifts 
relative to the light wave irradiated by the transmitter. 

3 0 Desirably however to determine the phase of the 

reception signal at each pixel of the photonic mixing 
element from the resulting correlation amplitudes, use is 
made of four different measurements in regard to four 
different phases of the mixer signal. That provides for 

35 over-determination, by means of which the noise can be 
significantly reduced. 
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The push-pull arrangement of the modulation photogate 
voltages at two modulation photogates per pixel provides 
that two respective ones of those measurements are 
implemented at the same time. Therefore, for example in 
5 the case of HF-modulation, it is sufficient to implement 
two measurements which are respectively displaced through 
90^ at 0^/180^ and also at 90^/270"^ phase difference in 
respect of the modulation photogate voltages U^^(t) and 
Ui3j^(t) respectively with respect* to the phase of the 

10 radiated light in order to acquire the four different 
measurement values necessary. 

A particularly preferred arrangement therefore is one 
in which the photonic mixing element respectively forming 
a pixel comprises four symmetrically arranged modulation 

15 photogates, wherein each two respective mutually oppositely 
disposed modulation photogates are acted upon with push- 
pull or 180°-phase-shif ted modulation photogate voltages, 
wherein the two measurements which are respectively 
.r:>.displaced through 9 0° and which have been described 

2 0 . hereinbefore in connection with the dual pixel, with a 
0^/180*^ and also 90*^/270° phase difference of the modulation 
photogate voltages, are implemented simultaneously in this 
case. Such a pixel can also be referred to as a quadruple 
pixel . 

25 Furthermore, for calibration of the phase shift of the 

modulation photogate voltages U3^^(t) and Uj^m^*^) 
preferably possible for a part of the light waves 
irradiated by the transmitter to be directed as a reference 
directly onto at least one of a plurality of pixels of an 

30 arrangement of a plurality of photonic mixing elements. 
The phase and amplitude information obtained from that 
directly irradiated pixel can then be used for the 
calibration operation or can be employed for adjustment of 
the phase shift to a predetermined value. 

35 Conversely, in the case of independently excited, 

unknown modulation of the incident light wave radiated by 
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an active object, by means of at least one photonic mixing 
element, it is possible to measure the light wave with the 
known high level of resolution of a lock-in amplifier. For 
that purpose the photonic mixing element together with a 
5 tunable modulation generator which is in place of the 
transmitter forms a phase-lock loop. In addition, both in 
lock-in amplification the phase-lock loop is used for 
example for HF-modulation and also the delay- lock loop is 
used for digital modulation. 

10 For surveying passive objects, modulation of the 

irradiated light and corresponding modulation of the 
modulation photogate voltages U^^(t) and U^^j^Ct) respectively 
can be implemented in various ways. First of all it is 
possible to effect continuous HF-modulation, in which case 

15 the charge differences and the charge sums are read out 
repeatedly at intervals which can be retroactively 
influenced by the pixel intensity, for evaluation of the 
phase and amplitude information of the light wave. 

An advantageous procedure is an intermittent mode of 

20 operation with pulse-form HF-modulation and lighting, for 
example in order for example in each case briefly to exceed 
an interference background lighting. In that case only the 
photo-generated charges are respectively integrated during 
the HF-pulse and then evaluated. 

25 In determining in particular the phase or transit time 

information of reflected light waves, to increase the level 
of phase or transit time resolution, it is possible to use 
the HF-pulse compression process known from the radar art, 
with narrow correlation functions, for example the chirp 

30 procedure. In that case, both the modulation signal of the 
individual photonic mixing element and also the light wave 
of the transmitter, which lights with a predetermined phase 
relationship, and thus also the light wave reflected with 
the phase relationship being sought, is repetitively 

35 modulated with a chirp. By virtue of chirp modulation, in 
a suitable manner, the insertion of an adjustable delay 



between the modulation photogate voltage of the photonic 
mixing element and the light irradiated by the transmitter 
provides for resolving multiple targets or suppressing 
troublesome multiple reflections of a lit scene. 
5 Pseudo-noise modulation ( PN-modulat ion) described 

hereinafter is available as a further form of modulation, 
both as base band-PN- and also HF -PN-modulat ion . A 
sampling procedure with sample -and-hold operations in the 
case of repetitive light signals is a special case of 

10 mixing and correlation with needle pulses. The photonic 
mixing element according to the invention can 
advantageously be used in this case also and for other uses 
of pulsed modulation. 

The modulation modes referred to are per se all known 

15 from the state of the art. 

The charges which have drifted to the accumulation 
gates can now be the subject of further processing in 
various ways. On the one hand, the photonic mixing element 
can be constructed using CCD- technology , in which case the 

2 0 charges are collected or integrated beneath the 
accumulation gates and then displaced in conventional 
manner to the CCD-read-out circuit, for example in a three- 
phase shift cycle, and read out by way of p- or n- 
dif fusion . 

2 5 On the other hand, the photonic mixing element can be 

embodied using CMOS- technology as an active pixel element 
with pixel-specific electronic reading-out and signal pre- 
processing system. In that case, in practice the reading- 
out circuit which is conventional in CCD-engineering is 

30 taken at both respective sides directly to the modulation 
photogate. In that case the accumulation gates are 
preferably in the form of blocked low-capacitants pn-diodes 
and transmit the arriving photo-generated charges 
preferably directly, by way of the electrodes G-^ and to 

35 the electronic pixel reading-out and signal pre-processing 
system for storage and processing there. 



In the latter case therefore the two charge components 
of the charge swing are continuously read out and can be 
stored practically in a reaction-free manner, for example 
with a charge amplifier, on a respective downstream- 
5 connected capacitor. 

The state of the art provides that, before each new 
measurement operation, the involved, charged-up capacitors 
are discharged by means of electronic reset switches and 
that desirably the fault voltages measured in the reset 

10 condition are used for correction of the actual measurement 
values. That use of the pixel -wise reaction- free reading- 
out procedure affords the advantage that the entire 
dynamics of the photonic mixing element and therewith the 
measuring method can be considerably enhanced in comparison 

15 with implementation using CCD- technology . 

In a further preferred manner it is possible to 
directly compute the phase and amplitude information in an 
electronic pixel reading-out and signal pre-processing 
system, preferably in the form of on-chip integration. 

20 Such an application-specific opto-electronic chip (ASOC) or 
such an active pixel sensor (APS) enhances the measuring 
rate and permits pixel -wise pre-processing of the phases 
and/or amplitudes . 

An important advantage of the present invention is 

25 that modulation is effected simultaneously with charge 
generation and separation. In other words, detection and 
mixing take place at the same time and without additional 
noisy and band-limiting intermediate stages. Therefore, 
the time drift errors which occur inter alia in the state 

3 0 of the art are prevented, the charge modulation and 
integration operations which are separated in terms of time 
and space from the detection operation necessarily occur 
and are not to be suppressed. 

A further advantage of the present invention lies in 

35 the high limit frequency of the photonic mixing element. 
The limit frequency of charge transfer by the push-pull 



modulation voltage is comparable in terms of the maximum 
drift length or transfer distance, that is to say the sum 
length of the modulation photogates, with the limit 
frequency of corresponding MOS- transistors , and thus 
5 attains the GHz -range. In addition, troublesome common- 
mode signals are suppressed by virtue of anti- symmetrical 
charge carrier separation and difference formation. Each 
interference signal which does not correlate with the 
modulation signal, for example the background' lighting, is 

10 suppressed in the charge difference, and that results in a 
high signal-to-noise ratio. Furthermore, there is only a 
slight time drift because of the combination of detection, 
mixing and charge carrier integration and difference 
formation on the same chip. In addition, a combination of 

15 practically all measurement functions becomes possible 
within a single semiconductor structure. 

In comparison with the state of the art disclosed in 
DE 44 3 9 298 Al with the use of Pockel cells as modulators, 
. only .low modulation voltages in the 1 instead of 1000 volt 

2 0 range are necessary. In addition, a 2D -arrangement of 

photonic mixing elements according to the invention ensures 
a large aperture on the receiver side. 

In addition, no coherent or polarised light is 
required for determining the phase and/or amplitude 

25 information. Accordingly it is possible to use further 
specific properties of the incident light waves by the 
upstream arrangement of selective filters, for example in 
respect of polarisation and wavelength of the light. In 
addition, the arrangement affords a high level of 

30 sensitivity and a high signal-to-noise ratio by virtue of 
the elimination of the electronic mixers and wide-band 
photodetector amplifiers which are used in accordance with 
the state of the art . ' \ 

The spectral optical band width of the light waves to 

3 5 be surveyed is determined by the spectral photosensitivity 

of the material used in the space charge zone under the 
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photogates, that is to say for example in the case of 
silicon approximately the wavelength range of 0.3 to 1.1 
/xm, in the case of InGaAs about 0.8 to 1.6 fim and in the 
case of InSb about 1 to 5.5 /xm. 
5 The photonic mixing elements can be disposed in any 

zero-, one- or two-dimensional arrangement, and thus afford 
a wide spectrum of use geometries. In that respect, 
several 100,000 photonic mixing elements can be operated in 
parallel relationship with a modulation band width of for 

10 example 10-1000 MHz, so that for example a camera shot of 
a 3D-scene can be implemented extremely quickly, with 
determination of the distance information in each pixel. 
The phase image <^{x,y) or - in the case of modulated 
lighting - the distance image or depth image with the 

15 radius vector or voxel distance R(x,y) is determined in 
pixel -wise manner by way of the charge differences of the 
charges which flow to the accumulation gates and which are 
read out. The corresponding charge sums afford the 
conventional pixel grey value A(x,y). The two can be 

20 combined to give the scaled grey value image or the 3D- 
image A(x,y, z) . 

In that respect, the 3D- image repetition rate is in 
the range of about 10 Hz to over 1000 Hz and depends on the 
number of photonic mixing elements used and the level of 

25 light intensity. By means of additional colour filters, it 
is possible to obtain the usual colour values red (x,y) , 
green (x,y) and blue (x,y) of the distance image R(x,y) . 

The integrated structure of mixing and charge carrier 
integration not least also provides for a simple structure 

30 in respect of the photonic mixing element. Finally, there 
is no need to involve particular expense in the. reception 
channel for a conventional optical imaging system is 
sufficient for imaging of the incident, possibly reflected 
light wave, if a one- or two-dimensional scene and not just 

3 5 a point is to be recorded. The measuring apparatus can be 
flexibly adapted to different 3D-scenes by virtue of 
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synchronous zoom of the optical transmitting and receiving 
system , 

In the case of the method according to the invention 
and the corresponding mixing element or an arrangement of 
5 a plurality of mixing elements, it is desirable if the 
pixel phase or the pixel transit time and the pixel 
brightness are ascertained directly by means of an active 
pixel sensor structure (APS) and then read out selectively 
or also serially preferably by way of a multiplex structure 

10 disposed on the same chip (the so-called on-chip multiplex 
structure) . That increases the processing speed and also 
reduces the number of further components required. 

If moreover pixel brightness is evaluated as the sum 
of the charges of the associated accumulation gates, as a 

15 grey value image, a particularly preferred embodiment of 
the invention is one which, in the case of background 
lighting, that is to say in the case of non-modulated 
lighting which is present beside the modulated lighting, 
eliminates by computation the charges produced by that 

20 additional lighting at the accumulation gates, by a 
procedure whereby the difference is formed between the grey 
value images which are achieved on the one hand with 
modulated lighting switched on and on the other hand 
without the modulated lighting, that is to say after the 

25 modulated light source is switched off. No correlation 
information is contained in that basic brightness or that 
base amount of the charges at the accumulation gates so 
that the actual correlation information appears more 
clearly after subtraction of that base amount. 

3 0 As already mentioned it is obviously appropriate if a 

plurality of the mixing elements are used either in a 
linear array, a surface array or a spatial array. In that 
respect, the term "linear" array is intended to mean not 
only a set of mixing elements which are arranged in a 

35 straight row in side-by-side or successive relationship but 
generally a set of mixing elements which are arranged along 



a line, wherein said line can be straight or also curved. 
In the case of the surface arrangements also, it is not 
only possible to provide planar mixing element arrangements 
in the form of a rectangular matrix even if that may also 
5 be preferable for practical reasons, but in principle the 
mixing elements can be arranged in accordance with any 
desired pattern and also on a curved surface, for example 
on the inside surface of a spherical shell. It is also 
possible to use arrays of the mixing elements on angled 
10 surfaces, that is to say simultaneously on two surfaces 
which include an angle with each other, and such 
arrangements are appropriate for given applications. 
Arrangements of that kind are embraced by the term "spatial 
array" . 

15 In the case of such arrays comprising a plurality of 

and possibly several hundred or thousand mixing elements, 
an advantageous and desirable configuration of the method 
according to the invention is one in which at least one of 

. :-. the pixels or mixing elements is directly irradiated with 

20 a part of the intensity-modulated electromagnetic wave 
serving as lighting, in which case the measurement result 
obtained in that way is used at said at least one pixel for 
calibration of the other phases and brightness results. In 
that respect it is desirable if such a reference pixel is 

25 acted upon by the transmitter with selectively different 
levels of intensity or, for the situation where a plurality 
of reference pixels are used, each of those pixels is acted 
upon by a different level of intensity. That makes it 
possible to avoid errors which can possibly occur by virtue 

30 of the large dynamic scope of the measurement signals. 

In the case of a one- or multi-dimensional mixing 
element arrangement of the above- indicated kind it is 
desirable if the pixels are constructed' using MOS- 
technology on a silicon substrate and can be read out with 

35 a multiplex structure, preferably with a CCD-structure. 

It will be appreciated that the mixing elements 



according to the invention are readily suitable for use in 
a digital photographic camera or video camera. For that 
purpose, it is only necessary to provide a suitable mixing 
element arrangement (for example in the form of a 
5 rectangular matrix) with integrated receiving optics, 
electronic evaluation system and signal processing for the 
difference signals, the sum signals and the associated 
reference signals, together with a digital memory for the 
grey value image computed therefrom, and the transit time 

10 or distance image. The arrangement also includes a 
suitable transmitter or a suitable light source which 
radiates a three-dimensional scene with modulated 
electromagnetic waves or modulated light, and transmitting 
optics which are suitably adjustable to the receiving 

15 optics, wherein all of those components are combined 
together to constitute a compact unit as a digital camera. 
In that respect the difference between a digital 
photographic camera and a digital video camera is 
essentially only that, in a corresponding video camera, a 

2 0 relatively large number of images has to be recorded and 

stored in correspondingly short intervals of time so that 
suitable devices must be provided for the storage and 
reproduction of corresponding image sequences. 

It will be appreciated that in addition in all uses 
25 lighting or illuminating a scene can be implemented with 
modulated light from various spectral regions, so that the 
colour components or chromatic components of the images, 
which are obtained in that way, can be used to acquire and 
reconstruct complete colour images with the spatial depth 

3 0 information which is supplied at the same time. 

For a higher band width and for example, also for 
improved edge detection, it may be desirable to use a 
microlens optical system in which associated . with each 
mixing element or pixel is a microlens optical system which 
35 reduces the incident light to the central region of the 
pixel so that deviations from the ideal potential 



configuration at the modulation gates which occur in 
particular in the edge regions of the photosensitive 
surfaces are practically removed. In addition, out-of- 
focus imaging, which is produced by means of the microlens 
5 optical system, in the detector plane of the mixing 
elements, can ensure that the imaging of edges, the imaging 
of which extends randomly in the centre between the two 
pixel halves, does not result in the generation of 
difference charges at the accumulation gates, which 

10 simulate a correlation or false depth information. 

Arrays with the photomixing elements according to the 
invention are also highly suitable for detecting and 
possibly also tracking predetermined one-, two- or three- 
dimensional structures in the field of view of the 

15 arrangement in question and with consideration additionally 
being given to the depth information or the object distance 
of the object which is being sought and which is possibly 
to be tracked. 

. . In specific terms, selectively determining the 

20 amplitudes and the displacement of the X-, Y- and the time 
coordinate T of the modulation signals by (AX, AY, AT) 
(wherein X and Y define two linearly independent 
coordinates which extend on the plane of a mixing element 
matrix and time T means the transit time delay of the 

25 modulation signals) provides for the implementation of a 
three-dimensional correlation, whereby a predetermined 
three-dimensional object is sought in space, detected and 
possibly tracked. 

The photomixing element according to the invention 

30 additionally also has a wide area of application in the 
field of optical data transmission. In that respect the 
photomixing element according to the invention is simply 
used instead of a photodiode in a conventional optical 
signal receiver, possibly inclusive of signal regeneration, 

3 5 wherein the shape of the modulation signal is adapted in 
the optimum manner to the signal shape and the phase of the 



modulation signal is also adapted in optimum manner in a 
phase-lock loop to the phase position of the reception 
signal. In other words, the clock is obtained from the 
signal itself and used for optimum weighting of the 
5 reception signal, whereby the signal is separated in 
optimum fashion from the troublesome, noisy background. In 
that way, sensitivity and accuracy in respect of optical 
data transmission can be considerably improved in 
comparison with conventional photodiodes. This could in 
10 particular also permit a considerable increase in the 
length of the optical transmission sections without 
intermediate amplification and a higher number of parallel 
communication channels in a time, frequency and code 
multiplex mode. 

15 Finally, the photomixing element according to the 

invention can also be used for example in optically-based 
position detection systems, wherein the mode of operation 
is in principle similar to that involved in the known GPS- 
system which permits very accurate determination of 

20 position by means of satellite transmitters which permit 
the encoded radiation of signals. In a corresponding 
optical position detection system the satellite transmitter 
which is known from the GPS -system would be replaced by a 
widely dispersive, modulated light source which is arranged 

25 correspondingly closer to the object whose position is to 
be determined, for example by means of laser diodes and an 
optical dispersion or scatter system, while the receiver is 
formed by one or more photomixing elements on the object, 
preferably by a plurality of photomixing elements which are 

30 oriented in various directions in order to detect the 
signals from light sources stationarily arranged at various 
points, with different modulations. In that case the 
encoded modulation permits a clear association of 
stationary light sources and the object whose position is 

35 to be determined, as well as the associated signal transit 
times, by means of which the position is determined. 



A further use is that of a demultiplexer for optical 
data transmission. Encoding in the form of special 
modulation and the associated correlation by means of the 
photomixing element permits a clear association of various 
channels . 

A further application and use of the high level of 
phase sensitivity of the photomixing elements according to 
the invention lies in the measurement of the Sagnac effect, 
that is to say the transit time or phase shift of light 
waves in rotating reference systems. For that purpose, 
modulated light is coupled into an optical fibre which is 
preferably laid in a plurality of turns and the output of 
the optical fibre lights one of the photomixing elements 
according to the invention. The modulation gates of that 
mixing element are modulated with the same frequency as the 
coupled- in light waves so that the correlation result in 
the form of the charge distribution at the photomixing 
element supplies a measurement in respect of the current 
frequency or phase shift. During each revolution of the 
reference system in which the axis of rotation is not in 
the plane of the turns of the optical fibre or optical 
waveguide, frequency and transit time and therewith also 
phase position change and are automatically detected by the 
photomixing element. It is worth noting in that respect 
that, with the photomixing element, such fibre gyro compass 
systems based on the Sagnac effect can now be embodied by 
means of incoherent light, which do not give rise to any 
problems in regard to their long-term stability as the 
corresponding sources of error in accordance with the state 
of the art, the high-frequency amplifier downstream of the 
optical detector and the electronic mixer, are completely 
eliminated . 

In addition, besides absolute directional measurement 
which is made possible with such a system, it is also 
possible to effect speed measurement of a moving object by 
means of the photomixing element according to the 



invention, for example insofar as a part of the light waves 
is removed in a beam splitter before being introduced into 
the optical waveguide and is directed onto a stationary- 
object, in which case the light reflected by the stationary 
5 object is captured by a suitable photomixing element 
receiver and evaluated in the manner which has already been 
described on a number of occasions, here in regard to the 
Doppler frequency shift. 

Depending on the respective meaning and significance 

10 of the additional depth information of a line or matrix 
image, a given number of photomixing elements can be 
integrated in the appropriate technology in a CCD-, CMOS- 
or TFA (Thin Film on ASIC) -image sensor. 

Furthermore, in the use of a 3D-line or matrix camera 

15 in accordance with the invention, it may be appropriate 
additionally to use a conventional 2D-camera, wherein a 
preferably spectral allocation and feed of the active 
modulated illumination component to the 3D-camera, and of 
the other unmodulated illumination component, is preferably 

20 effected with a beam splitter. 

For uses of the photomixing elements for 3D- 
measurement or surveying, for greater distances for which 
the modulated lighting is too weak, it is possible to use 
a combination of at least two 3D-line- or matrix cameras, 

25 in which case in accordance with the invention measurement 
or surveying is effected in the near region on the basis of 
the transit time principle and in the far region on the 
basis of the triangulat ion principle with inter alia 
existing background lighting. 

3 0 In that case depth measurement in the near region is 

implemented as described hereinbefore, in this case in 
parallel by way of at least two cameras. 

For depth measurement in the far region', the optical 
axes of the cameras, which are formed by way of the PMD- 

3 5 chip centre point, are directed onto a common point of 
intersection in the volume region to be measured, for 



example by suitable PMD-chip displacement in the horizontal 
and vertical directions and in respect of the PMD-chip 
spacings, wherein at the same time focussing of the optical 
systems of the cameras are set to that distance. With 
suitable previous adjustment the pixel brightness values 
then coincide in that volume region of greatest depth 
sharpness . 

For the detection and identification of the objects in 
that volume region, in the event of correspondence of the 
pixel amplitudes, the sum image of the photomixing elements 
is added by a briefly applied dc modulation voltage, in 
respect of the difference image, associated with the set 
distance data and evaluated, while the non- corresponding 
pixel amplitudes are removed in the difference image by a 
modulation voltage which is set to zero, = = 0. 

In that way, by means of angle scanning, the 3D-scene 
is also measured and surveyed outside the range of the 
modulated transmitter lighting, wherein the necessary 
angles are attained both by suitable displacement of the 
PMD-chips and also by rotation of the individual stereo 
cameras and/or by pivotal movement of the entire 
arrangement , 

The many possible uses of which only some are herein 
described in part in detail and in part only briefly 
indicated are also to be found in the following list 
setting forth further possible uses, the further 
description of which would go beyond the scope of the 
present application, in which respect the following list is 
also in no way exhaustive. 

More specifically possible uses are meaningful and can 
be envisaged in the following areas: 

Digital 3D-photographic camera. 

Digital 3D-video camera, 

Danger area monitoring, 

Security engineering and "intelligent buildings". 
Occupant detection and identification in motor 
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vehicles, "intelligent air bag". 

Electronic 3D-rearview mirror. 

Recognition of the traffic situation in road 
traffic , 

5 - Autonomous vehicle navigation, 

Incoherent fibre gyro and Doppler speed 
measurement , 

Control of autonomous transport vehicles. 
Industrial cleaning robots, 
10 - Personal identification, authent if icat ion and 

checking of access authority. 

Identification of objects, for example vehicles. 
Production monitoring, material testing, 100% 
quality testing, 
15 - Electronic "3D-eye" for a robot hand, robust, 

small, all solid state. 

Vehicle speed and distance-covered measurement, 
road condition detection, traffic jam, 

Track free signalling, contact wire monitoring on 
2 0 railways. 

Medical engineering, endoscopy, 

CDMA- engineering for optical free-space or line 
communication. 

Interactive 3D-communication for example in the 

2 5 multimedia area, and 

3D-measurement of moving objects with a line of 
photomixing elements . 

In that respect the following advantages of the 
photomixing elements of the present invention are to be 

3 0 emphasised (abbreviated hereinafter as "PMD" standing for 

"Photonic Mixer Device") : 

1. PMD combines: detection, push-pull mixing and 
integration in a very small space of 1/100 l/lOOO mm^ => 
electro-optical correlation . 
35 2. 2-times/4-times-PMD : substitute for 2 or 4 

expensive wide-band amplifiers with high dynamics and group 



transit time constancy and for 2 and 4 electronic mixers 
respectively . 

3. The high level of electronic cross-talk 
sensitivity between transmitter and receiver is eliminated. 
5 4. High level of integratability with some 100,000 

parallel electro-optical modulators . 

5. A PMD-3D-photographic or video camera is fully 
integratable , small, light, robust and flexibly adaptable 
by an optical zoom system for light transmitter and 

10 receiver. Measurement volumes for natural surfaces, 
distances of about 2 0 cm to 50 m with aperture angles of 
about 5° to 5 0°. 

6. Extremely fast 3D-image recording in the 10 Hz - 
1000 Hz -range. Sensitivity and S/N-ratio correspond to 

15 presentday CCD- and CMOS-cameras. 

7. The expected depth resolution is about 0.5 mm to 
5 0 mm depending on the respective measurement time, 
lighting intensity, optics involved and spacing by virtue 
of optimum reference. 

2 0 8. Maximum band width according to respective pixel 

size up to the GHz-range. 

9. Modulation voltages in the range of less than 1 

volt . 

10. No coherent, polarised or narrow-band light is 
2 5 required and the spectral range depends on the light- 
sensitive material (for example in the case of InSb up to 
5 . 5 ^m) . 

11. Simultaneous recording of the 3D-depth image and 
the 2D-grey value image, by virtue of data fusion, affords 

30 optimised evaluation of the 3D-grey value image (or 3D- 
colour image) . 

12. The read-out circuit, by virtue of intensity- 
dependent variation in the integration time T\, permits an 
increase in the dynamics by about 8 bits (factor 256) . 

35 The invention will now be described in greater detail 

hereinafter by means of embodiments given by way of 
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example, with reference to the drawing in which: 

Figure 1 shows in a) a view in cross-section of a 
pixel of a first embodiment of a photonic mixing element 
according to the invention using CCD- technology and in b) - 
5 f) the potential distribution UgCt) for the various phases 
or times of the two complementary modulation photogate 

voltages U^^m^^) ^bm^^^' 

Figure 2 shows a block diagram of two linearly 

arranged pixels using CCD- technology including a part of an 
10 interline transfer reading device. 

Figure 3 is a diagram showing the intensity 

distribution of the incident light and the potential 

patterns of the voltages Ug3p(t), U^(t), U^m^t), U]3j^{t) and 

Uj^Ct) in the case of HF-modulation, 
15 Figure 4 is a diagram showing the characteristics of 

the mixing and correlation result of the photonic mixing 

element in the form of the averaged photo -generated charge 

carrier currents and j; drifting to the accumulation gates 

in the case of HF-modulation in dependence on the relative 
20 phase or transit time shift <« =a) t / 

• T opc to 

Figure 5 shows a diagram for PN-modulation, 
illustrating in a) the modulation signal, in b) the 
characteristics of the mixing and correlation result both 

for a dual pixel (only and j; ) and also for a quadruple 

25 pixel with 2; in the case of a delay in the modulation 

signal for the third and fourth modulation gates cm and dm 
of Tq and in c) the. difference values Ar^^Ar^^=r^-r^^(r^-r^) 

at aT ~r -T -(T -T) which are relevant for . distance 
evaluation, 

30 Figure 6 shows in a) a view in cross- sect ion of a 

pixel of a second embodiment using CCD- technology of a 
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photonic mixing element according to the invention with a 
middle modulation photogate Gq as well as the potential 
distributions under the modulation photogates and 
accumulation gates b) for a positive and c) for a negative 
5 modulation voltage U^(t), 

Figure 7 shows in a) a view in cross-section of a 
pixel of a third embodiment of a photonic mixing element 
according to the invention and in b) - f) the potential 
distributions for the various phases, similarly to Figure 
10 1, 

Figure 8 is a plan view showing a pixel of a fourth 
embodiment of a photonic mixing element according to the 
invention with four modulation photogates and four 
accumulation gates, referred to as a quadruple pixel, 
15 Figure 9 is a plan view showing a pixel of a fifth 

embodiment of a photonic mixing element according to the 
invention with four modulation photogates and four 
accumulation gates and a central symmetrical middle gate Gq , 
r. Figure- 10 is a diagrammatic view of an apparatus known 
2 0 from the state of the art for determining the phase and 
amplitude information of a light wave. 

Figure 11 is a diagrammatic view of an apparatus 
according to the invention for determining the phase and 
amplitude information of a light wave for HF-modulation, 

2 5 Figure 12 is a diagrammatic view of an apparatus 

according to the invention for determining the phase and 
amplitude information of a light wave, for example for PN- 
modulation or rectangular modulation. 

Figure 13 shows in a) a view in cross-section of a 
30 pixel of a sixth embodiment of a photonic mixing element 
according to the invention with electronic pixel read-out 
and pre-processing system using CMOS- technology and in b) 
and c) the potential distribution similarly to Figure 6 for 
two phases or polarities of the modulation photogate 

3 5 voltage, and 

Figure 14 is a plan view of a pixel of a sixth 
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embodiment of a photonic mixing element according to the 
invention with four modulation photogates, four 
accumulation gates and a middle gate Gq, of a cross-shaped 
configuration, preferably for digital modulation. 
5 Figure la shows a view in cross-section of an 

individual pixel 1 of a photonic mixing element using the 
example , of a CCD-structure, In that case the photonic 
mixing element, besides the pixel 1, includes the 
structures necessary for the voltage supply and the signal 
10 take-off operations. The outer gates Gg^p only serve for 
electrically delimiting this pixel in relation to adjacent 
structures . 

The arrangement shown in Figure 1 is formed on a p- 
doped silicon substrate 2. The mixing or multiplication 
15 operation of the proposed concept will firstly be 
considered for pure CW high-frequency modulation. 

In relation to the cross-section Figure lb - f 
diagrammatically shows the potential distributions for 
various phases of the mixing procedure. The middle 

2 0 modulation photogates G^^ and Gj^^ represent the light- 

sensitive part and are in the inversion state. In addition 
to a positive bias voltage Uq at the conductive or optically 
partially transparent upper cover for example of 
polysilicon they are operated with the superimposed push- 

25 pull voltages U^(t). That affords the modulation voltages 
Uam(t) = Uo+U^(t) and U^^Ct) = Uo-U^(t) respectively. 

They mult iplicatively cause a separation of the 
minority charge carriers generated by the photons of the 
incident light wave in the space charge zone immediately 

30 beneath the insulating layer 3, for example of silicon 
oxide or silicon nitride. Those charge carriers (in the 
example in question being electrons) drift under the 
influence of the modulating push-pull voltage to the 
closely adjacent positive accumulation gates G^ or Gj^ and 

3 5 are there integrated on while the majority charge carriers 

or holes flow to the ground terminal of the p-Si-substrate . 



Rearward illumination is also possible. 

Figure 2 shows a plan view of two pixels 1 of the 
photonic mixing element according to the invention 
including a part of an interline transfer reading apparatus 
5 7 in the form of a 3 -phase CCD shift register, at one end 
of which is disposed the electronic reading-out system with 
a diffusion junction for serial processing of the charge 
values obtained by correlation. After a predeterminable 
time T for charge accumulation under all accumulation gates 

10 of the line for example at pixel No n the charges and 

under and are passed by way of the respective transfer 
gate TG^ and TG^ to the 3 -phase read-out shift register. 
The delimiting separation gates Gg^p protect the correlation 
pixel from undesired external influences and are preferably 

15 at ground potential. 

Figure 3 shows the voltage configurations associated 
with Figure 1. The modulation photogates G^^^ and Gy^^ are 
operated by means of the modulation photogate voltages 
shown in Figure 3, including a phase-opposition HF- 

20 modulation voltage Uj^(t), which are described as follows: 

and 

^t^^^o^^aPOS (co^t-180°) =U^-U„cos (a)^t) ( lt> ) 

Figure lb - f clearly shows the potential distribution 
25 Uq{s) in the space charge zone above the spatial extent s 
of a representative pixel 1. for all gates in question of 
that pixel in the time sequence from tQ to tg for the 
duration of a period T^^ of the HF-modulation signal. At the 
accumulation gates G^ and G^ a relatively high positive 
3 0 voltage provides for the accumulation of the photo- 
generated charge carriers after they have drif.ted eitTner 
predominantly towards the left or towards the right side of 
the pixel 1 shown in cross-section in Figure 1, according 
to the polarity of the modulation photogate voltages U3j^(t) 
35 and Uu,j^(t) . That operation has a particular effect when 
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light modulation and the modulation photogate voltage U^^(t) 
involve the same frequency. Then, depending on the 
respective phase difference <^opt there is a mean 
preferential direction of the charge carrier drift to the 
5 accumulation gates and Gj^ . The associated averaged 

currents are described by j-^ and . 

The underlying correlation procedure can be 
mathematically described as follows: In the reception 
plane of the most general case of 2D-arrays of photonic 

10 mixing elements z = 0 and the incident modulated light wave 
is there generally described by P^p^. (x, y, t- r) . Here, it is 
described by way of the photo-generated charge carriers 
with the push-pull modulation signal acting there, in 
general form by U^(x,y,t), approximately multiplicat ively 

15 and integratively linked in terms of the charge differences 
in respect of the two accumulation gates . The 
corresponding correlation function <^um, Popt ^ ' 
described for example for all averaged differences of the 

charge carrier drifts A<7^/r=Ai"^=r^-i; (with T = integration 

2 0 time) to the accumulation gates G^ and G^, in the most 
general case, in dependence on location, as the triple 
convolution : 

with the transit time difference r = </?opt/^m' modulation 
2 5 angular frequency w^^ and the constants k-^ and k2 which are 

dependent on structure but which are unimportant in terms 

of the operating principle. 

The photonic mixing element in accordance with the 

invention achieves that aim with a high level of positional 
30 and time resolution by virtue of the rapid, ^separating 

charge transport of the photoelectrons and their push-pull 

storage and difference and sum evaluation. In that 

respect, by virtue of forming the difference of the 
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averaged drift currents Ar^(c) =r^(c:) -!;( t) which are time- 
dependent in the case of non- stable light waves, all 
troublesome offset components are suppressed and at the 
same time the desired correlation function in respect of 
5 the light signal Popt^^"^) with the modulation voltage U^(t) 
is formed. 

That procedure is to be described in greater detail 
herein. The HF-drift field caused by way of U^^(t) and 
Ui3^(t) provides that the electrons drift to the respectively 

10 positive side. During for example the positive half -wave 
of the modulation photogate voltage U^j^(t) = Uo+Uj^(t), that 
is to say during the negative half -wave of U]^j^(t) = Uq- 
U^(t) , the photo-generated charge carriers will drift to the 
accumulation gate and are there accumulated or passed on 

15 as a charge quantity (see the two upper modulation 

photogate voltage distributions in Figures lb and c) . 
Figure 3, for the situation of stable, harmonically 
modulated lighting, represents the optical power per pixel 
as : 

20 Popt(t-r) = Po+P^cos(a;t-(^opt) 

wherein Pq represents the mean value inclusive of the 
background lighting, P^^ represents the modulation amplitude, 
oj^ represents the HF-modulat ion frequency, <Popti represents 
the phase delay and t = (p^^^/co^ represents the corresponding 

25 transit time delay of the incident light wave with respect 
to the modulation phase at G^^. The total photocurrent 
generated per pixel is: 

i(t) = Sx-Popt(t-T) = S;,- [Po + P^-cos(a)^t-(^^pt) ^ (4) 

30 

i(t) = Io + Im'COS(cJ^t-</?opt) (5) 

with the parameters i(t) = i^ (t ) +1^ ( t ) , Iq = mean value of 
the pixel photocurrent in accordance with Pq , Im = 
35 alternating amplitude of the modulated photocurrent in 
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accordance with P^^, and S^^ = spectral sensitivity. That 
entire photocurrent per pixel is divided into two 
components, more specifically into the current ia(t) of the 
accumulation gate and into the current i]3(t) of the 

5 accumulation gate Gy^. As those values are integrated - in 
CCD- technology under the respective accumulation gates 
and and in the case of CMOS- technology which reads out 
in pixel -wise manner preferably in the electronic reading 
system - it is sufficient hereinafter for consideration to 

10 be given to the mean values j- and r of those currents. The 

maximum in terms of charge separation is achieved for the 
angle <p^p^ = 0 and r = 0. That situation is shown in Figure 
3 . 

Harmonic modulation affords, under the assumption of 
15 idealised conditions such as suitable modulation amplitude, 
negligible drift transit times, 100% modulation depth with 

= Pq for the mean photocurrents and respectively: 

i;=^.^cos(9opc) 

20 Figure 4 shows the configuration of these idealised 

mean pixel currents. They represent the opposite-phase 
correlation functions which result from the HF-modulated 
reception light and the HF-modulation photogate voltages 
applied at the modulation photogates G^^ and Gy^^. The sum 

25 thereof corresponds to Iq of the mean pixel light power Pq . 
The total charge quantity which is accumulated over the 
time T = N*Tj^ (that is to say over N periods T^^ of the HF- 
modulation voltage) affords: ' 

3 0 with a transit time r = ^./cOj^ corresponding to the phase 



delay. Hereinafter q^^ is only identified by . The 
totality of the charges of the accumulation gates and 
respectively of all pixels 1 forms two locationally 
discrete HF- interf erograms , the a- interf erogram and the b- 
5 interf erogram which is displaced through 180° with respect 
to the a- interf erogram, and from them, by differencing, is 
formed the transit time-determined difference HF- 
interf erogram which is being sought and which is described 
by equation (2) . 

10 Figure 11 is a diagrammatic view of a 3D-camera 

according to the invention which uses direct mixing on the 
basis of an array of photonic mixing elements. Compared to 
the 3D-camera concept known from the state of the art, 
which is shown in Figure 10, in Figure 11 modulation of a 

15 transmitter 4 for lighting of optically passive 3D-objects 
is implemented by direct modulation of the current of a 
laser diode. In that case modulation is produced by an HF- 
generator 13. For larger distances, it is advantageous for 
example to use a high-power laser diode array with 

2 0 preferably common modulation current and - for the purposes 

of eye safety - of different wavelengths. 

A first optical system 5 forms an image of the light 
wave on the surface of an object 6. The light wave 
reflected by the object 6 is then projected through a 

25 second optical system 7 onto the surface of a photonic 
mixing element array 8 . 

The photonic mixing element array 8 is also actuated 
by the HF-generator 13, wherein actuation is effected for 
different phase shifts relative to the phase of the 

30 radiated light wave by the HF-generator 13. The signals of 
the photonic mixing element array 8 are finally- evaluated 
by an evaluation unit 9, if this has not already been done 
on-chip . 

On the basis of the measuring apparatus according to 

3 5 the invention, no additional optical modulator with a high 

aperture is needed for the proposed 3D-camera concept. 



beside the photonic mixing element array according to the 
invention, and that affords a structure which is 
economically advantageous . 

For the purposes of determining the pixel phase <p^^^ 
5 from the resulting correlation amplitudes, use is made, as 
set forth hereinbefore, of a total of four different 
interf erograms in the case of four different phases of the 
mixer signal. The four phases of the mixer signal arise in 
the situation where the modulation photogate voltages U^^^ 

10 and U]3^ are switched over from the state of the phase 
relationship of O^/ISO"^ to the state of 90^/270° or delayed 
through 90^. That gives the two associated imaginary or 
quadrature components in relation to the real or in-phase 
components, from which the pixel phase being sought can be 

15 computed, in accordance with equation (10) described 
hereinafter. 

That mode of operation at the same time makes it 
possible to eliminate troublesome offset voltages which are 
produced by the background brightness and by the mixing 

2 0 operation. 

Besides the measuring operation which is described by 
way of example in respect of CW-modulated 3D- light waves by 
2D-correlation with a modulation voltage U^(x,y,t) 
preferably of the same frequency in the plane of the 

25 photonic mixing element array it is possible for the 
measuring apparatus according to the invention also to be 
advantageously used with modulation signals in pulse form. 

In particular pseudo-noise modulation of the light is 
advantageous for tasks involving high-precision transit 

30 time measurement of 3D-light waves. An embodiment by way 
of example for surveying or measuring optically passive 3D- 
objects is shown in Figure 12. Similarly to the embodiment 
involving harmonic modulation in Figure 11 the; apparatus 
according to the invention has a suitable lighting device 

35 which lights the 3D-objects 6 with light which is 
PN (Pseudo-Noise) -modulated in intensity and the reflected 



and received light is subjected to the correlation 
procedure with preferably the corresponding PN-modulat ion 
signal which is produced by the generator 13 . 

As the correlation in respect of PN-signals of that 
5 kind with increasing word length = Tq(2^-1) resembles a 
triangular needle pulse with a half -value width equal to 
the bit width Tg, then for clear and complete measurement 
of the entire light volume or the entire space lit, a 
relative delay Tj^ between the light -modulating PN- signal and 
10 the demodulating PN-push-pull voltage U^^Ct) of the same 
signal shape at the modulation photogates must pass at 
least once through the entire delay range of the maximum 
echo transit time continuously or stepwise in Tg-steps. 
That purpose is served by the delay member 11 which is 
15 adjustable in respect of the delay by the control and 
evaluation unit 9. 

Figure 5a shows the modulation signal Uj^(t) , in regard 
to the example of a rectangular 15 bit PN-sequence. The 
' result of the correlation by the photonic mixing element is 

20 the averaged drift currents and shown in Figure 5b in 

relation to the relative delay r. 

In the case of the quadruple pixel described 
hereinafter, as shown in Figures 8, 9 and 14, the push-pull 
modulation photogate voltages which are applied to the 

2 5 modulation photogates G^^ and G^^ and which are superimposed 

on the bias voltage Uq are preferably delayed by Tg with 
respect to the push-pull modulation photogate voltages 
applied to the modulation photogates and Gy^, that is to 
say U^^{t) = Uo+U^(t-Tg) and U^^Ct) = Uo-U^(t-TB), which 

3 0 results in highly advantageous amplitude and transit time 

measurements . 

Except for a predeterminable delay Tj^ in respect of the 
modulation voltages the light intensity const . *PQpt ( t ) 
irradiated by the transmitter 4 involves the same PN-signal 
3 5 structure. The reflection reaches the photonic mixing 
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element after the echo transit time. The correlation with 
the push-pull modulation voltages results, in accordance 
with the respective relative transit time delay r for = 
0 in the ideal case without background brightness, in the 

5 case of the dual pixel in the mean pixel currents and 

shown in Figure 5b and in the case of the quadruple pixel 
with the stated Tg-time shift additionally in the mean pixel 

currents and . That correlation characteristic firstly 

reveals that a plurality of object reflections can be 

10 distinguished on the same radius vector, for example for 
distinguishing a plurality of partially transparent objects 
which are disposed one behind the other or for the purposes 
of eliminating multiple reflections. 

In addition, the sum and difference of the mean drift 

15 current differences, as shown in Figure 5c are preferably 
formed .in succession in the case of the dual pixel and 
simultaneously in the case of the quadruple pixel in the 
respectively corresponding electronic pixel reading-out and 
signal pre-processing system 15. They permit highly 

20 sensitive measurements as it is only in the Tq to 2Tg-wide 
measurement window that signal values that are not equal to 
zero appear. Evaluation of the sum makes it possible to 
determine the relevance of a measurement on the basis of a 
minimum amplitude. The difference shows a steep linear 

25 configuration in the useable Tg-wide measurement window, 
which permits the transit time to be determined with a high 
degree of resolution. The following applies for the 
example which is idealised here: 

3 0 The block diagram of a corresponding measuring 

apparatus for the optical measurement of 3D-objects with 
PN-modulation based on the proposed correlation 
photodetector array is characterised by a structure of 



particular simplicity, as can be seen from Figure 12. In 
that case, besides the generator 10 and the delay member 
11, the same structure as that shown in Figure 11 is 
involved . 

5 In accordance with the invention, for the purposes of 

rapidly ascertaining distance with a relatively low level 
of resolution, use is also made of simple rectangular 
modulation of the transmitter 4 by the generator 10 with 
the period T and preferably the same pulse and space 

10 duration Tg . The operation of ascertaining transit time is 
implemented in accordance with equation (9) . The level of 
resolution is increased stepwise by the period duration T 
which decreases with the factor 2, in which case the first 
measurement step is firstly followed by a second involving 

15 the same period but with a time shift Tj^ = T/4. 

The cross -section illustrated by way of example in 
Figure 1 of the pixel 1 of the photonic mixing element 
according to the invention can be optimised in respect of 
its limit frequency by a suitable configuration in terms of 

20 the potential gradient caused by the push-pull modulation 
voltage. In that respect, Figure 6 shows an embodiment by 
way of example in which a middle gate Gq is arranged between 
the modulation photogates G^^ and G^^, the middle gate 
preferably being at the bias voltage Uq and together with 

2 5 the modulation photogates G^^ and G-^^ forming three 

potential stages. What is desired is a potential gradient 
which is as uniform as possible or a modulation drift field 
which is as constant as possible, and that is achieved by 
increasing the number of stages from two to three or even 

3 0 more. In the photosensitive space charge zone the degree 

of definition or pronouncement of the stages decreases in 
any case with the spacing from the insulating layer 3 . 
That effect is used in a further embodiment in faccordance 
with the invention, more specifically by using what is 
35 known as a "buried channel", a weakly doped n-channel which 
is some fxm away from the insulating layer and which is 
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somewhat deeper in the p-substrate under the modulation 
photogates. The arrangement also includes a shading 12 for 
the accumulation gates and so that they are not lit by 
the light wave and additional charge carriers produced. 
5 Figure 7 shows a particular configuration and 

connection of photonic mixing elements in which, in 
comparison with that in Figure 1, the two modulation 
photogates are respectively only separated by a common 
accumulation gate j^, thereby achieving a higher degree of 

10 filling action. This arrangement also has a shading 12 for 
the accumulation gates and G^. In this case the polarity 
of the push-pull modulation voltages or the sequence of 
G^^^j-L and G^^^^^j^ changes from pixel to pixel. That triple 
period of the gates is suitable at the same time for direct 

15 reading-out by virtue of operation as a three-phase shift 
register. A disadvantage which can be tolerated in certain 
applications lies in the charge distribution also to the 
respectively adjacent pixels, which results in an apparent 
pixel size increase and a lower degree of positional 

20 resolution in the direction in question. 

Calculation of those interrelationships and influences 
shows that, in comparison with a 100% useful charge, upon 
evaluation of the charge differences, the central pixel 
considered acquires only 50% and the two adjoining pixels 

25 each acquire 25%. 

To illustrate the charge distribution. Figure 7, 
similarly to Figure 1, shows the various phases of 
potential distribution for CW-modulation . 

Figure 8 shows a further advantageous embodiment of 

3 0 the design of a pixel of a photonic mixing element which in 
the case of CW-modulation does not require any IQ (in- 
phase, quadrature -phase) -switching-over between the I- and 
Q-states. Instead of the above-described dual ipixel, the 
proposal is for a quadruple pixel with the modulation 

35 photogates G^^, Gy^^, G^^ and G^^ as well as the associated 
accumulation gates G^, G^, G^, and G^, which permits 
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correlation simultaneously for four phase positions, as the 
push-pull modulation photogate voltages U^^(t) and Ut3j^(t), 
Uc^(t) and U(^^(t) respectively are shifted relative to each 
other, in particular in the case of HF-modulat ion through 
5 90°. 

Therefore, in an orthogonal arrangement with respect 
to the described modulation photogates G^^ with ip^^ = 0° and 
with (p^^ = 180°, there are two further modulation 
photogates G^^ with (p^.^ = 90° and G^^ with <p^^ = 270° which 

10 are symmetrically integrated within the pixel and which 
operate on the basis of the same principle. That affords 
a four-phase charge accumulation with the individual 
charges q^, q^^, q^^ and q^ under the associated accumulation 
gates G^, Gj^, G^ and G^ or in the associated electronic 

15 reading-out system, wherein by means of a simple 
arithmetical operation the associated phase <p^^^ is directly 
computed as follows: 

,„...„„^ (10) 

For simply determining grey values of an individual 

20 pixel, the individual charges of all accumulation gates of 
a pixel are summed: qpixel ^ ga+*3b'*"*3c"'"*3d • "^^^ reading-out 
process in respect of the respective four charges is 
desirably implemented in this case by an active pixel 
design using CMOS- technology with pixel-wise integrated 

25 signal pre-processing. 

Figure 9, like Figure 8, shows a quadruple pixel of a 
photonic mixing element, but with a potential gradient 
which is smoothed as shown in Figure 6, by means of the 
central square middle gate Gq which is preferably at the 

30 potential Uq . . , . 

Figure 14, like Figure 9) shows a quadruple pixel' of 
a photonic mixing element with a structure which is 
optimised for digital modulation signals. The middle gate 
Gq , arranged between the preferably square modulation 

35 photogates, serves in a similar manner to Figure 9 for 



smoothing the potential gradient produced by the modulation 
photogate voltage . 

Finally Figure 13 shows a further preferred embodiment 
of a pixel 1 which, in contrast to the above-discussed 
5 embodiments, is implemented not using CCD- technology but 
CMOS -technology with electronic pixel-wise reading-out and 
signal pre-processing system 15. In this case, the mode of 
operation of the modulation voltage-dependent drift of the 
charge carriers on the charge swing is the same as in the 

10 above-discussed embodiments. The only difference in the 
embodiment shown in Figure 13 is the manner of implementing 
further processing in respect of the charges and q^^ which 
have drifted to the accumulation gates and G^. 

In the present embodiment the accumulation gates and 

15 Gj^ are in the form of blocked pn-diodes. The positively 
biased accumulation gates G^ and are formed by n^- doped 
electrodes on a preferably weakly doped p-Si- substrate 3 in 
Figure 13. In what is known as the "floating-diffusion" 
mode of operation or in the high-resistance voltage read- 

20 out mode, as in the case of using CCD- technology , the 
charges q_^ and q^^ are integrated on the capacitances of the 
accumulation gates G^ and G^^ and are read out in a high- 
resistance mode in the form of voltage values. 

It is advantageously also possible to use a current 

25 read-out mode in which the photogenerated charge carriers 
are not integrated in the potential well but are 
continuously passed by way of output diffusion by way of 
suitable current read-out circuits which are connected to 
the accumulation gates G^ and G^ respectively. Those 

30 charges are then integrated for example on a respective 
external capacitance. 

A reading-out circuit in the current read-out mode 
which keeps the accumulation gate voltage ; virtually 
constant by virtue of amplifier feedback advantageously 

35 ensures that, upon intensive irradiation of the pixel, the 
quantity of the accumulated charges q^ and q^^j does not 
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result in a reaction on or indeed overflowing of the 
potential well. The dynamics of the photonic mixing 
element is thereby considerably improved. In this case 
also the above-specified technology involving a weakly 
5 doped n-channel ("buried layer") under the insulating layer 
of the modulation gates affords improvements, inter alia an 
increase in the limit frequency. 

Constructing the photonic mixing element using CMOS- 
technology further permits the use of an active pixel 

10 design (APS) with which, at each pixel, a read-out and 
signal pre-processing circuit can be integrated into the 
photonic mixing element. That permits pre-processing of 
the electrical signals directly at the pixel before the 
signals are passed to an external circuit. In particular 

15 it is possible in that way to calculate the phase and 
amplitude information directly on the chip so that the 
measurement rate can be further enhanced. 

A further configuration of the invention provides for 
using a preferably two-dimensional photonic mixing element 

20 array for a three-dimensional electronic object search and 
tracking procedure of passively or actively illuminating 
objects on the basis of various criteria, such as for 
example object shape, position, colour, polarisation, speed 
vector, brightness or a combination of object properties. 

25 If for example in the passage of various modulation signals 
(for example frequency or code alteration) in the 3D- 
measurement of an incident light wave which can initially 
be unknown, a local correlation is found by the criterion 
of difference drift currents not equal to zero, .then that 

3 0 object range can thereafter be continuously measured 
specifically in respect of said object properties and 
tracked, possibly in the event of changes, by way of a 
regulating loop which in particular also includes image 
depth. 

3 5 The photonic mixing element is used in various modes 

of operation which are set forth hereinafter. 
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In this respect the sum charge at the accumulation 
gates and is of less interest as it always corresponds 
to the total intensity of the incident light waves, qa+^b = 
const . *Popt,ges*'^ with T = integration time. 

The difference charge ^q^^Q^-q^^i,.T-^^.T depends on a 

plurality of factors and can be used in many ways for 
measuring the incident light wave. For that purpose, 
consideration is given to a basic brightness' which is 
always present Po> = (see Figure 3a) . 

Optionally for example when measuring an object 6 
which is lit by a transmitter 4 with modulated light the 
transmitter power is switched on or off and thus becomes 
finite or equal to zero. At the same time optionally the 
modulation voltage U^(t) either becomes zero or it is 
switched to the configuration used in the transmitter and 
contained in the incident light, or to a voltage U^q which 
is constant during the integration time. 

Accordingly, with Pq^^O that gives four important modes 
of operation: 

1. ) Aq^t, = 0 for P^ = 0 and = 0 . 

2. ) Aq^i^ = 0 with finite P^ and with U^(t) as an HF- 
modulation signal . 

3. ) With finite P^^ and a high-frequency modulation 
voltage Aq^j^ is a function of Uj^(t), the relative transit 
time shift r and the incident light power component Pj^(t) 
which is modulated in that way. 

4. ) If during the integration time T there is an 
incident mean light intensity Pq and a constant modulation 
voltage U^^r then the difference charge Aq^^^ is a function 
of U^o mean light power Pq . 

In the case of light waves which are not intensity- 
modulated, a further configuration of the ; invention 
provides that the photonic mixing element is used in 
accordance with the fourth case of a possible mode of 
operation, for example for 2D-image processing. 
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In that case each mixing element is actuable 
specifically and independently of each other, for example 
by pixel-wise association of a respective rapidly over- 
writable modulation voltage word for U^q preferably by means 
5 of a RAM- component . Preferably evaluation is effected only 

in respect of the difference charges T*^i^ difference 

drift currents which are approximately proportional to 

U^Q . In that case the modulation voltage U^^q is 

respectively derived from the modulation voltage word, 

10 That means that Uj^(t) is no longer set periodically or 

quasi -periodically as in the preceding examples of use but 
aperiodically , for example in accordance with a 
predetermined image content or in accordance with the 
measured image content. For U^(t) = 0 all difference 

15 currents are zero so that the associated difference image 
D(x,y) also appears with the amplitude or intensity zero. 

Difference image brightness can thus be specifically 
influenced by a variation in Uj^(x,y,t). In that way in 
accordance with the invention any light waves or images, 

20 that is to say even unmodulated ones, can be subjected to 
versatile image processing by way of an extremely rapidly 
settable weighting function G(x,y,t) = k^*!!^ (x, y , t ) , for 
example by way of the above-mentioned controllable, pixel - 
wise associated memory cells, such as for example the 

25 above-mentioned uses for object search and tracking, but in 
that case without the aspect of depth information. 



